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(54) Method and system for addressing audio-visual content fragments 



(57) A process (900) is disclosed for applying an 
audio-visual addressing scheme to locate fragments of 
audio-visual content The process (900) comprises a 
definition sub-process (902). an encoding sub-process 
(904), and a decoding sub-process (906). The definition 
sub-process (902) defines a logical model (908) for a 
class of audio-visual media. The logical model (908) is 
used in the encoding sub-process (904) for encoding an 
address for an audio- visual resource fragment belong- 
ing to the class of audio-visual media. The logical model 
(908) is also used for locating the audio-visual resource 
fragment that is associated with the address. 
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Description 

Copyright Notice 

[0001] This patent specification contains material that is subject to copyright protection. The copyright owner has 
no objection to the reproduction of this patent specification or related materials from associated patent office files for 
the purposes of review, but otherwise reserves all copyright whatsoever 

[0002] The present invention relates generally to retrieval of data from data bases, and in particular, to retrieval of 
audio-visual data. 

[0003] The advent of technology providing mass-market access to the Internet places vast amounts of on-line infor- 
mation within relatively easy reach. The World Wide Web (WWW) (hereunder, the Web) underpins much of the growth 
of Internet use, particularly because of the ease of use, and also due to the intuitive user interface presented by Web 
browsers. Universal Resource Indicators (URIs) are a ubiquitous addressing feature used to locate target resources in 
the Web context. This is particularly relevant when Web pages are used in conjunction with a Common Gateway Inter- 
75 face (CGI) scripting application, which allows the Web page to become, in essence, the front end of a myriad of data- 
bases accessible over the Internet. 

[0004] Notwithstanding the explosive progress described however, a Web user is, in most cases, unable to "drill 
down" beyond a certain level of data, and must, in many cases, down-load an inconveniently large and cumbersome 
amount of information in order to locate useful information. Illustrating this fact, consider investigating all flights from 
London to Moscow departing from Heathrow airport on a given date. In order to make a selection based on a number 
of criteria such as departure time, airline, number of stops and so on. a long list of flights typically needs to be down- 
loaded and scanned, either manually or using a back-end application on a local personal computer (PC). 
[0005] Further exemplifying the problem, certain types of data such as, for example, audio-visual (AV) data, typi- 
cally manifest themselves as monolithk: blocks of infonmation. The internal structure of such data, whether it be a par- 
ticular video segment, or fragment, in a movie, or a specific movement in a symphony, is neither visible, nor addressible, 
or consequently accessible in temris of fragments. 

[0006] Taking a more extreme example, off-line audio-visual data, in the fomi of celluloid film archives, paper-based 
libraries, and a wealth of other sources, are also not addressable, and are thus invisible and inaccessible at the -frag- 
ment" level. Although particular books can be located, by call number and location in a library, specific chapters thereof 

30 are not visible or addressable, and consequently, not accessible. 

[0007] Extensible Markup Language (XML) provides a drill down capability for a limited sub-set of on-line informa- 
tion, namely Information whk:h is coded in XML. However, useful as this may be. the ovenwhelming bulk of available 
information has been produced in other programming formats such as Hypertext Markup Language (HTML), or alter- 
natively, is in hard copy form in physical archives and libraries. The aforementioned types of information are referred to 

35 as "legacy" infomiation. 

[0008] It is an object of the present invention to substantially overcome, or at least ameliorate, one or more disad- 
vantages of existing an^ngements. 

[0009] It Is an object of the present invention to substantially overcome, or at least ameliorate, one or more disad- 
vantages of existing an^ngements. 
40 [001 0] According to a first aspect of the invention, there is provided a method for addressing an AV fragment of an 
AV resource over a network, to an arbitrary level of resolution, said AV resource being a member of a class of AV 
resources, wherein a logical model is associated with members of the class of AV resources; said method comorisina 
steps of: ^ ^ 

4$ determining a URI network address for the AV resource; 

applying the logical model to the AV resource to form a hierarchteal representation of the AV resource including a 
representation of the AV fragment; 

determining a fragment identifier for the fragment dependent upon the representation of the AV fragment; and 
combining the URI network address and the fragment identifier to fomi a URI reference, being an address for the 
50 AV fragment 

[001 1] According to a further aspect of the invention, there is provided a method for locating an AV fragment of an 
AV resource over a network, to an arbitrary level of resolution, said AV resource being a member of a class of AV 
resources, wherein a logical model is associated with members of the class of AV resources; said method comorisina 
55 Steps Of: ^ 

using a URI network address portion of a URI reference to locate the AV resource; 

identifying (i) a type of the AV resource, and (li) the logical model, dependent upon one of (a) the fragment identifier. 



2 



BNSDOCID: <EP 1087309A2 I > 



EP 1 087 309 A2 



(b) the URI. and (c) the fragment identifier and the URI; and 

applying an XPath based addressing scheme to the fragment identifier, said scheme including at least one of a time 
axis, a time function, a region axis, and a region function, for addressing temporal and spatial fragments of the AV 
resource, thereby locating the AV fragment. 

5 

[0012] According to a further aspect of the invention, there is provided a method for addressing an AV fragment of 
an AV resource over a network, to an arbitrary level of resolution, said AV resource being a member of a class of AV 
resources, wherein a logical model is associated with members of the class of AV resources; said method comprising 
steps of: 

70 

determining a URI network address for the AV resource; 

applying the logical model to the AV resource to form a hierarchical representation of the AV resource including a 
representation of the AV fragment; 

determining a fragment identifier for the fragment dependent upon the representation of the AV fragment, including 
15 a sub-step of identifying (i) a type of the AV resource, and (ii) the logical model, dependent upon one of (a) the frag- 
ment identifier, (b) the URI, and (ill) the fragment identifier and the URI; wherein said identifying step comprises a 
sub-step of applying an XPath based addressing scheme to the fragment identifier, said scheme including at least 
one of a time axis, a time function, a region axis, and a region function, for addressing temporal and spatial frag- 
ments of the AV resource; and 

20 combining the URI network address and the fragment identifier to fomi a URI reference, being an address for the 

AV fragment. 

[001 31 According to a further aspect of the invention, there is provided an apparatus for addressing an AV fragment 
of an AV resource over a network, to an arbitrary level of resolution, said AV resource being a member of a class of AV 
25 resources, wherein a logical model is associated with members of the class of AV resources; said apparatus compris- 
ing: 

first detemiining means for determining a URI network address for the AV resource; 

applying means for applying the logical model to the AV resource to form a hierarchical representation of the AV 
30 resource including a representation of the AV fragment; 

second detemiining means for determining a fragment identifier for the AV fragment dependent upon the represen- 
tation of the AV fragment; and 

combining means for combining the URI network address and the fragment identifier to form a URI reference, being 
an address for the AV fragment. 

35 

[0014] According to a further aspect of the invention, there is provided an apparatus for addressing an AV fragment 
of an AV resource over a network, to an arbitrary level of resolution, said AV resource being a member of a class of AV 
resources, wherein a logical model is associated with members of the class of AV resources; said apparatus compris- 
ing: 

40 

first determining means for determining a URI network address for the AV resource; 

first applying means for applying the logical model to the AV resource to form a hierarchical representation of the 
AV resource including a representation of the AV fragment; 

second determining means for determining a fragment identifier for the fragment dependent upon the representa- 
45 tion of the AV fragment, including Identifying means for Identifying (i) a type of the AV resource, and (il) the logical 
model, dependent upon one of (a) the fragment identifier, (b) the URI, and (ill) the fragment identifier and the URI; 
wherein said identifying means comprises second applying means for applying an XPath based addressing 
scheme to the fragment identifier, said scheme including at least one of a time axis, a time function, a region axis, 
and a region function, for addressing temporal and spatial fragments of the AV resource; and 
50 combining means for combining the URI network address and the fragment identifier to fomi a URI reference, being 
an address for the AV fragment. 

[001 5] According to a further aspect of the invention, there is provided an apparatus for locating an AV fragment of 
an AV resource over a network, to an arbitrary level of resolution, said AV resource being a member of a class of AV 
55 resources, wherein a logical model is associated with members of the class of AV resources; said apparatus compris- 
ing: 

utilisation means for using a URI network address portion of a URI reference to locate the AV resource; 
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[001 61 According to a further aspect of the invention, there is provided a comDuter readahio m»n,««. ,^ ^- , 
code for a first determining step for detemiining a URI network address forthe AV resource- 
eo* (or a combW„B «.p to, oorttr^ URI n.»„H, addr», ana the ta3m«« WMIi^.o to™ . URI 

code for a first determining step for detemiining a URI network address for the AV resource- 
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^de fer' ;„"S^rSl" ""tr " ""^^^^ ^^^^^^^ « ^ locate the Av'resource- 

Sin/i ""^^ ^'"^'"^ ^" '^'^^^ addressing scheme to the fragmem identifier said scheme 

Hg. 1 depicts a prior art system for accessing audio data on a CD ROM using the Internet 
Rg. 2 Illustrates indexing typically provided for a CD ROM according to Rg l - 

inventio^"^ ' '"^^^'"^ ROMs according to the present 

Rg. 4 shows a process for applying an audio-visual addressing scheme to locate fragments of audio-visual «,nto„f 
Fig. 5 Illustrates application of the method in Rg. 3 to addressing a fragment of aSoTte on a CD ROm! ' 
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Fig. 6 depicts the preferred embodiment applied to addressing a fragment of digital video content on a CD ROM; 
Fig. 7 shows a process for locating audio-visual fragments using the "avptr" addressing scheme; 
Fig. 8 shows a process for evaluating a location step in Fig. 7; 
Fig. 9 shows an exemplary process for locating video data on a digital video tape; 
5 Fig. 10 shows an exemplary process for locating visual data in a region; 

Fig. 1 1 shows an exemplary process for locating audio data on an audio CD; 
Fig. 12 depicts the locating of resources using conventional URIs; 

Fig. 13 illustrates use of extended URIs for fragment location according to the pretended embodiment; and 
Fig. 14 is a schematic block diagram of a general purpose computer upon which the preferred embodiment of the 
10 present invention can be practiced. 

[0020] Where reference is made in any one or more of the accompanying drawings to steps and/or features, which 
have the same reference numerals, those steps and/or features have for the purposes of this description the same func- 
tion(s) or operation(s), unless the contrary intention appears. 

15 [0021 ] It is noted that the introductory part of the description makes reference, for illustrative purposes, to audio and 
video content which is stored on Compact Disk Read Only Memory (CD ROM) media accessed by a "Juke Box" device 
which is capable of storing a number of such disks and accessing them according to an address. 
[0022] Fig. 1 depicts a prior art system used to locate an audio content CD ROM 312 using the Internet 308 as a 
vehicle. A user (not shown) uses a personal computer (PC) 304 which is connected to the Internet 308 in order to con- 
so nect to the server 306 of an on-line music provider. The sen/er 306 is connected to a CD ROM juke box 310 which 
houses a plurality of CD ROMs 312. 316. Each CD ROM 312, 316 contains individual songs exemplified, for illustrative 
purposes only, by bold lines 314, 318 respectively. The user has a paper description 300 of the desired CD ROM 312 
containing a title 326 of the CD ROM, and also a list of the songs 302. 320. The user uses a Universal Resource Indi- 
cator (URI) 324 which "points" to the address of the CD ROM 312. and the user is able to download music from the CD 

25 ROM 312 over the system. 

[0023] In Fig. 2, the CD ROM 312 can be portrayed In a description 400 as containing a list of songs 402, 404 under 
a title 414, where the song 404 has indices 410 and 412 which point to particular segments within the song 404. Jem]- 
nology such as "songs" is used for illustration in this part of the description, noting that in fact, as described, the audio 
content is actually stored on CD ROM as noted. For example in classical music where the "song" 402 can be an indi- 

30 vidual movement of a symphony, and therefore can be quite long, the index 1 (ie 41 0) can point to a trumpet solo, and 
the index r (ie 41 2) can point to a violin solo of interest. Depending upon the capabilities of the server 306 and juke box 
310 In Rg. 1, the user can address the desired CD ROM 312, and address a desired index 410. It is noted however, 
with reference to both Fig. 1 , and to Fig. 2, that the user is limited to addressing, and so accessing, material only down 
to the level of the particular CD (ie 312), or perhaps the specified predefined index (ie 410). It is not possible to "drill 

35 down" to an arbitrary further specified level of fine grain detail. 

[0024] Fig. 3 depicts an illustrative embodiment of an addressing method, in this case to be used in relation to audio 
CD ROMs. The CD ROM 312, fomierly described by the description 400 which contains a list of individual songs 402, 
each of whfch may contain a level of indexing (eg 410 see Fig. 2) Is extended, using a logical model based upon con- 
secutive time blocks or slices, and using a set of rules defining how the logical model is to be applied, into a hierarchical 

40 representation comprising both the description 400 and the further description 500 comprising time blocks 502 to 51 2. 
The logical model, when applied to the CD ROM 312, serves to form a hierarchical representation of the otherwise mon- 
olithic AV content of the CD ROM 312. The model thereby enables systematic and rapid addressing of arbitrary content 
fragments on a time block basis, and provides the desired arbitrary drill down capability. Using the described represen- 
tation, a user is able, for example, to select an arbitrary fragment of audio content on the CD ROM 312 by specifying a 

45 fragment address, or fragment identifier, of the form Title / songi / block 2 • block j-3*, where j is an arbitrary index as 
shown in Fig. 3. The present logical model is used for illustrative purposes, and more advantageous logical models and 
addressing schemes are proposed later in the description. In Fig. 3 song 402 is shown to comprise blocks 502 to 506, 
song 2 comprising blocks from the block after 504 through to block 506 and so on. 

[0025] Rg. 4 shows a process 900 for applying an audio-visual (ie AV) addressing scheme to locate fragments of 
50 audio-visual content. The process 900 comprises three sub-processes, namely a definition sub-process 902, an encod- 
ing sub-process 904. and a decoding sub-process 906. The definition sub-process 902 defines, as depicted by an 
arrow 910, a logical model 908 for a class of AV media. After the definition sub-process 902. the logical model 908 is 
used (as depicted by an arrow 912) in the encoding sub-process 904 for encoding an address for an audio-visual 
resource fragment belonging to the class of AV media. The logical model 908 is also used (as depicted by an annow914) 
55 for locating the audio-visual resource fragment that is associated with the address. 

[0026] Turning to Rg. 5, the hierarchical representation 602, comprising descriptions 400 and 500, is shown In a 
system content in more detail. By using the fragment identifier 61 0, derived from the hierarchical representation 602, in 
conjunction with the URI 324 (see Fig. 1), an extended URI 606 (commonly referred to as a "URI reference' is shown 
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T i"" '° '^'9- ' ' ^"^ *'«g^ent identifier 608 The URI ref- 

erence can thus be used as an address to the CD 312. and further, to the desired fragment 314 

Seo rfh ! hierarchical representation 706. determined using a logical model appropriate for dig- 

ital video. In this example, a sequence of digital video shots 700 is recorded on a CD ROM 7?zi t^^L^ I , 



70 



15 



20 



axis :: node-test [predicates] 

where axis specifies the tree relationship between the nodes selected by the location step and the context 

"^^^ ^^^^-^ P-^^-^- the set of notes selL^^^ 

[00321 A number of syntactic abbreviations allow common cases to be expressed concisely as follows: 

@ is short for attribute::, e.g. attribute: :type can be abbreviated as ©type 
// is short for /descendant-or-self::node()/, 
. is short for self::node(), and 
.. is short for parent::node(). 

[0036] A function library provides a set of predicate functions such as countO Dositionrt idn la^tn t:^ * 
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turn. 

[0038] Some examples of XPath location paths are as follows: 

/doc/chapterf2]/section[3] 
5 selects the third section of the second chapter of doc 
chapter[contains(strtng(title). "Overview"] 

selects the chapter children of the context node that have one or more title children containing the text "Overview" 
child: :*[self::appendix or self::index] 
selects the appendix and index children of the context node 
10 chHd::*[setf::chapter or self::appendix] [posltion()=first()J 

selects the first chapter and appendix children of the context node 
para[@type=*'warning"] 

selects all para children of the context node that have a type attribute with value "warning" 
para[@id] 

15 selects all the para children of the context node that have an id attribute. 

[0039] XPath operates on the logical structure of an XML document, this logical structure being defined either 
explicitly by a Document Type Definition (DTD), or implicitly by an^ngement of tags. For instance, the examples given 
in the previous section assumed an XML document with the structure, in Extended Backus-Naur Fomri (ENBF) as fol- 
20 lows: 

doc ::= toe chapters appendix" index 
chapter ::= section* 
section ::= para+ 
25 appendix ::= section* 

where toe" means table of contents", '+" means "one or more. """ means zero or more", and the composite 
description presented above describes, in expanded forni, a document comprising a table of contents, one or 
more chapters, zero or more appendices, and an index, where each chapter comprises one or more sections, 
30 where each section comprises one or more paragraphs, and finally where each appendix comprises one or 

more sections. 

[0040] In an XML document, each of these structures is marked by a pair of appropriately named tags. The tag 
markup allows the logical structure of the document to be determined unambiguously. Hence, any applbation that 
35 understands the syntax of XML can determine the location of the document's components. Any application that under- 
stands the XPath and XPointer notations can use an URI with an XPath/XPolnter fragment identifier to locate parts of 
the document 

[0041] Audio-visual, or AV content, is not stored as XML documents and cannot be marked up. However, given an 
unambiguous logical structure, or model, a modified XPath location/addressing method can be used. Hence, for each 
40 class of AV content, in the first instance, an unambiguous logical structure must be defined, and in order to make It 
widely accessible, the logical structure should preferably be published. By an unambiguous logical structure or model, 
it is meant that different persons and applicattons will segment given content in exactly the same way given the model. 
[0042] Considering one type of AV content, for instance. Digital Video format as used by digital video cameras, this 
can be modelled as: 

45 

dv ::= frame* 

where this means a digital video comprising one or more frames. 

50 [0043] in the case, for example, where compatible digital video cameras generate meta-data to represent and 
record the instances the camera starts recording (designated a REC event), a shot can be defined as an interval 
between two REC event. In this case, the model for DV format is: 

dv ::= shot* 

55 

shot ::= frame* 

meaning a digital video comprising zero or more shots, each shot comprising one or more frames. 
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[0044] As another example, the logbal structure of Compact Disc Audio can be modelled as follows: 

cdAudio ::= track* 
track ::= channel channel index* 
5 channel ::= sample* 

meaning an audio CD comprising zero or more tracks, each track comprising two channels, and zero or more 
indices, and each channel comprising zero or more samples. 

10 [0045] Considering a more complex example, consider Digital Video Disc, or DVD. video which can provide: 

over 2 hours of high-quality digital video (over 8 on a double-sided, dual-layer disc), 
up to 8 tracks of digital audio, each with as many as 8 channels 
up to 32 subtitle/karaoke tracks 

up to 9 camera angles (different viewpoints) can be selected during playback 
up to 32 separate subpicture channels 



75 



[0046] Other data types include Video Manager Information files. Video Title Set files. Program Chain Infomiation 
J^^es st,|l picUire Video Objects, attributes for Trtle. Part.of.Trtles. and Menus. Time Map Tables. Part o Trie ^eaS 
20 Pointers, and Navigation Commands. i me oearcn 

[004J DVD-Video content is broken into titles and chapters (or parts of titles). Trtles are made up of cells linked 

Jlf wJ?^ °? °' '"^'"^ '^^"^ '^'^ ^ "^^'^ ^ *an one PGC Different PGCs 

de^ne different sequences through mostly the same material. Additional material for camera angles and branching is 
mterleaved together .n small chunks. The DVD player jumps from chunk to chunk, skipping over unused anS or 
25 branches, to Stitch together the seamless Video. s u»er unusea angies or 

[0048] One logical model for DVD-Video is: 

dvdVideo .:= mainMenu? title* subpteture* file* 
mainMenu ::= menu* 
30 menu ::= menu* 
title ::= chapter+ 

chapter .:= view+ audio+ subtitle* 
view::=frame+ 
audk) ::= channek 
35 channel :> sampler 

[00491 The previous logical models each relate to a class of AV content, namely digital video, compact disc audio 

and d.g,talv«deo disk. AS noted, the appflcation of the logical modelsto the associatedA?contemp»^^^ 
representations of the AV content whfch supports addressing of fragments of the content nieiart^Ical 

^ • ^ "^""""^ *° ^^^"^ °^ addressing, each location step Is evaluated with respect to a context The context is 
m, .al y the root node. dvdVideo in this case. In general, the context is the results of a prior location «ep The^oTset 

atT^n?. Tr T " """^ '^^'^ '^"'^ '""'^ node setfrom the axirand node te" 
and then filtenng that node-set by each of the predicates in turn. u-ioueiesi. 

^^^^ . ^^"^ ^ ^"^^ ^ ^"^"^ audio-visual fragments using the -avpti- addressing scheme This 
process 1000 depicts the decoding sub-process 906 in Rg. 4. A URI reference 1002 (htlpy 2om co^pr^^^ 
ucts/dvdOl ii#avptr(/dvdVideoAitle/chapter/audio[1J)) is provided, as depicted by an arrow 1004 whrteTqSro 
an arr^w 916 ,n Rg 4^to a step 1006. In the step 1006. the URI portion (http:/Avww.apxcom.com/products/dvd01 1 1 ) of 

Video i SuSf f " "^T- ' " ^ °' address il id 

/r K K K T Tu ^' " '° '^"'^"^'"^ ^ ^P«' ^""^ «>nsequently. an associated logical model 

the frajl^l^ " ^ *° ^® ^ "»de 

[0052] TTiereafter. a decision step 1 022 determines whether the aforementioned steps have determined the last 
locafon step required to locate the desired resource fmgment. If the last location step has been detS^d the p^ 
ess 1000 ,s directed, according to a -YES' arrow 1024. to a step 1026 in whfch the located resource Sgmenr^ p oc- 
essed. The step 1 026 is a post-location processing step. iragment is proc 

S "J"! ^°22 detemiines that the last location step has not been determined, then the process 

1000 IS directed, according to a -NO* arrow 1028. to a step 1030 which evaluates the next location step within me cur- 
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rent context. This Is described in more detail with reference to Fig. 8. Thereafter, In a step 1034, node(s) are selected 
that satisfy the specified selection criteria (see Fig. 8 for description of these criteria). In a following step 1 038, the con- 
text is set to the node(s) selected, and the process 1 000 is then directed, according to an arrow 1 040, to the testing step 
1022. 

5 [0054] Fig. 8 shows a process 1 100 for evaluating the "evaluation of a location" step 1030, which is shown as a 
dashed box. The dashed box 1 030 in Fig. 8 corresponds to the sub-process 1 030 in Rg. 7. The step 1 030 is a location 
step of the form axis::node-test[predicates]. In a first step 1102 {which follows the decision step 1022 in Rg. 7 as 
depicted by the an-ow 1028), a hierarchical relationship specified by the axis is used to select a set of nodes within the 
cun'ent context. Thereafter, in a step 1 1 06 the node test is performed, thereby selecting nodes that are of the specified 

10 node type or node name from the cun-ent node set In a following step 1 1 1 0, the predicates are applied to each node in 
the current node set, selecting only those nodes that satisfy the predicates. 

[0055] The described AV location scheme can, utilising a notation and mechanism similar to those of 
XPath/XPointer, locate analog and digital AV content within a database, or a plurality of databases. 
[0056] A set of named functions are defined for the AV location scheme. For instance, 

15 

time(startTcme [.endTime]) 

For determining whether the current context is within the specified time. 
timecode(startTimeoode [, endTimecode]) 

For determining whether the current context is within the time specified by the start and end timecodes. 

20 

[0057] The functions can be used for evaluating expressions, the evaluation always occun-ing with respect to the 
current context. 

[0058] In addition, new axes can be added, for instance, a time axis and a region axis for locating temporal and spa- 
tial segments of the data. The incorporation of these axes provides additional power to the concept of fragment 
25 addressing, and allows drilling down to different aspects of the AV content. 

[0059] The time axis selects, within the current context, components that occur within the specified start and end 
time. The current context is talcen as starling at time zero and progressing continuously through time in nomial play 
time. If the end time is not specified, it is taken to be the same as the start time and the component that occurs at or 
closest to the specified start time is selected. 

30 

TimeLocationStep time' StartTime (',' EndTime)? 
TimeUnit 'hTrnTsTms' 
TimeNotation ::= 'end' I ([0-9]+ TimeUnit) 
StartTime ::= TimeNotation 
35 EndTime ::= TimeNotation 

[0060] For example, 

http://www.apxcom.com/products/dvd01 1 1 #avptr(/dvdVideo/title[2]/time::0m.1 5m) 1 ] 

40 

selects the first 15 minutes the second title of the specified DVD. This example is designated example [1]. 
[0061 ] In example [1 ], the method works as follows: 



45 





Selection step 


Meaning 


Context after the selection step 


axis 


(default is child::) 


all the children of the context 
node 


all the children of the dvdVideo 
node, that is. all the mainMenu, 
title, subplcture and file nodes 


node-test and predicate 


Title[2] 


any title node whose position is 

2 


the 2"^ title nodes 


axis 


Time:: 


anange the current selection 
continuously in time starting at 
time zero 


unchanged 
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Selection step 


Meaning 


Context after the selection step 


node-test 


0m,l5m 


all content inside the time inter- 
val Ominto 15min 


the first 15 minutes of the 2"^ title 



10 



15 



20 



aepiaea by an arra, 1218 to a steo 1204 In ■bVm^ !? W,. i" ctescrlplion) Is provHM. as 

is a post-location processing s^p ' ''^S'^^"* « P"«e^ed. The step 121 6 

[0064] In a variation of example [1 ]: 



httpV/www.apxcom.corTi/products/dvd01 11#avptr(/dvdVideo/trtlerposrtlonO=1 
position{)=2)][tlme("0m-.-l5m-)] [2] lPosraon(;=i 

rofl«« '^'T titles of the specified DVD 

[00651 As another example. 

25 

httpyw^ap^^ 1 1#avptr(/dvdVideo/title[(posltion()=1 

position()=2][time(-0m-."l5m')] [3] 

^ fn"!^^ ""'""^^^ second titles of the DVD 

30 [0066] The method, applied to example [3], works as follows: 



or 



or 



35 



40 



45 



50 



55 





Selection step 


iVIeaning 


Context after the selection 
step 


axis 


(default is child::) 


all the children of the con- 
text node 


All the children of the dvd 
Video node, that is, all the 
mainMenu, title, subpicture 
and file nodes 


node-test and predicate 


title[positionO=l orposl- 
tron()=2I 


any title node whose posi- 
tion is either 1 or 2 


The first and the second title 
nodes 


additional predicate 


[timeC0m","l5m")] 


any content inside the time 
interval Omin to 16min (of 
each candidate node) 


the first 1 5 minutes of the 
first and the second titles 



TlmecodeLocationStep timecode' StartT.mecode ( •/ EnrfTimecode)^ 
T^mecodeNotation 'beginTend-lsmpteTimecodeltimelC- dateTime 
StartTimecode ::= TimecodeNotation 
EndTimecode ::= TimecodeNotation 
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[0068] For example, 

http://www.apxcom.eom/events/procluctLaunch99#avptr 
(/dv/shot/limecocle::00:1 5:00:00,00:30:00:00) [4] 

5 

selects 15 minutes of clips on the specified digital video tape using SMPTE timecodes 

[0069] The region axis selects, within the current context, the 2D region that is bounded by the specified bounding 
curve. The origin con*esponds to the top-left corner of a frame with the x- and y-axis coordinates increasing to the right 
and down. Coordinates are specified In (Integral) pixel values. Several types of bounding curves such as rectangle and 
10 ellipse allow the (anti-clockwise) angle between its major axis and the x-axis to be specified. To allow a region to be 
specified for different resolutions of the same content, the resolution of the source from which the bounding curve is 
determined could be specified using the range() function. 

RegionLocationStep 'region* [Range] BoundingCurve 
75 BoundingCurve ::= Shape 

Shape ::= Circle ! Ellipse i Rectangle I Polygon I QuadCurve I CubicCurve I Bspline 

Circle ::5s 'circle(' XCentre ',' YCentre Radius ')' 

Ellipse ::= 'ellipseC XCentre V YCentre Major \' Minor Angle ')' 

Rectangle ::= YectC Left '.' Top ',' Width '/ Height ',' Angle y 
20 Polygon ::= 'polygene Point '/ Point Point )+ •)' 

QuadCurve ::= 'qcurve(' Point Point (',' Point )+ 7 

CubicCurve ::=s 'ccurvef Point '/ Point (',' Point )+ ')' 

BSpline ::= 'bsplinef Point Point (•/ Point )+ *)' 

Point ::= Integer ',' Integer 
:'5 Integer ::= [+[-] Digits 

Angle ::= Degree 

Range ::= 'rangeC Integer',' Integer')' 
[0070] For example, 

30 

httpy/www.apxcom.com/events/productLaunch99#avptr(/dv/shot[1] 
/frame[1012J/region::range(720,480)rect(40,40.60,60,45) \5] 

selects a 60x60 diamond-shape region from the 1012^ frame of shot one of the specified digital video tape. 

35 [0071] Fig. 10 depicts the example [5] as a process 1300 for locating visual data in a region, using the 'avptr" 
addressing scheme. A URI reference 1302 (depicted as [5] in the body of the description) is provided, as depicted by 
an arrow 1 322, to a step 1 304 in which the URI portion (ie http://www.apxcom.com/events/produclLaunch99) of the U Rl 
reference 1302 is used to locate a resource. In a following step 1306, a root of the fragment address, ie dv in the URI 
reference 1 302, is used to determine a content type, and consequently, an associated logical model 1 308. In a following 

40 step 1310, the logical model 1308 is used to set the initial context to the n30t node of the fragment 

[0072] Thereafter, the process 1300 is directed to a step 1312 which evaluates the tocation step, ie shot[1] in the 
URI reference 1202, thereby selecting the 1 ^ shot node. Thereafter, in a step 1 314, the location step frame[1012] in the 
URI reference 1302 is evaluated, thereby selecting the node of .framet1012] of the l^shot node. Thereafter in a step 
1318. a location step region::Fange(720,480)rect(40,40,60,60,45) in the URI reference 1302 is evaluated, thereby 

45 selecting content within the specified rectangle of frame[1012] of the 1^ shot. Thereafter, the process 1300 is directed 
to a step 1320 in which the located resource fragment is processed. The step 1320 is a post-location processing step. 
[0073] As another example, 

http://www.apxcom.com/products/acd01 0239#avptr(/cdAudioArack[2]/channel/tinne: :0s.60s) [6] 

50 

selects the first minute of the second track of an audio CD which has the model 

cdAudio ::= track* 
track ::= channel channel index* 
55 channel ::= sample* 

[0074] The portion of the URI reference before the hash refers to the AV product, in this instance an audio CD no. 
010239, belonging to a class of products, ie audio CDs, produced by the fictitious company "apxcom", whteh is the 
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resource in this instance. What follows the hash siqn Is an "AV franmpnt WAntrf;^. • * x . 
content on the designated CD. The AV pointer is dLed tol tt^^^^^^ locating specific AV 

minute of the second track. Therefore, the URl (Universal Resoua:e IndfcaC^h^^^^^^ TJf '^l '"^ 

net addressing, when combined with a fragment identifier (the ^rt o?S 3m ?<Serance 

called a URl reference. reierence following the hash sign), is 



called a URl reference 
[0075] The location steps work as follows 



10 



15 



20 





Selection step 


Meaning 


Context after the selection 
step 


axis 


(default Is child::) 


all the children of the context 

node 


all the children of the cdAudio 
noue, inai is, ail the track nodes 


node-test and predicate 


track[2] 


any track node whose position is 
2 


the 2"** track node 


axis 


(default Is child::) 


all the children of the context 
node 


all the children of the 2"^ track 
node 


node-test and predicate 


channel 


any channel node 


all the channel nodes of the 2"^ 
track node 


axis 


time:: 


arrange the current selection 
continuously in time starting at 
time zero 


unchanged 


node-test 


tlme::0s,60s 


all content inside the time inter- 
val Osec to 60sec 


the first minute of the 2"^ track 



25 



30 



35 



40 



45 



SO 



55 



Keren?eT4S:£r^^^^^^ the iocaL step, ie trackI2] in the 

UB. reference .03. JJLir^^^^^ 

[0078] '"-'"'therexampie(no.f7]).theUR.toa15minu,essegmentofthesecondLXonaDVDcanhavethe 



httpy/vww.apxcom.com^roducts/dvd01 1 l#avptr(/dvdVideortitle[2ytime::30m.lSm) 
while a further example (na [8]), ie 

httpy/www.apxcom.com/products/dvd01 1 1#avptr(/dvdVideortitle/chapter/audio[1]) 



[7] 



[8] 



will select the first audio track of the DVD 

[0080] Rg. 1 2 presents a description of a prior art scenario in the context of an yw .^^ 

a browser (not shown). It is noted that the document 114 as shl7deS a PhvsicaTaso^^^^^ vm'IT"'"' °" 
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which in the present instance is a "Documentary". A number of hyperlink references 1 04, 1 06 provide links to other XML 
documents 120, 122. which describe movie sources and movie reviews (not shown) respectively. The movie sources 
refen-ed to by document 120 can be either on-line, or alternatively, can be a physical entities such as a video-cassette 
128 (depicting a specific movie source in this example) produced by a company. The document 1 14 contains a segment 

5 110 named "Rocket Launch" between tag delimiters 1 08 and 124. The rocket launch segment commences 15 minutes 
after the start of the documentary as indicated by the start index 1 1 2. When a user selects the release reference 1 04, 
the associated link depicted by an arrow 118 directs the user to the XML document 120 describing the movie source 
128 as already noted. Selection of a reference 132 on the document 120 retrieves a UR1 126. which points, as Indicated 
by an arrow 130, to the physical video cassette 128. The URI 126 is seen to comprise a link to a company having a 

10 domain name movies designated 1 34, where the specific cassette is designated "vhsOl 11 * ie 1 36 in the "products" cat- 
egory 138. Reviewing the aforementioned process for clarity of explanation, selection by the user of the Apollo 13 ref- 
erence 104 directs the user to the specific cassette 128 through a location process depicted by the UR1 126. Noting that 
the URI has a standard format and does not incorporate a fragment identifier, it is clear that the described scenario does 
not support drilling down to the fragment level of the non-XML AV resource. The URI does address the particular video 

15 cassette 1 28, but provides no mechanism for addressing AV data on the cassette at the fragment level. 

[0081] Turning to Fig. 13, a preferred embodiment of the proposed addressing method is described. Selection of 
the preview reference 200 on the main XML document 114 activates a link depicted by an arrow 202 which is directed 
to another XML document 204. This latter document 204 describes preview AV material at the fragment level, and 
selection of a reference 226 results in a link depicted by a dashed arrow 206 pointing to an AV fragment using an 

20 extended URI 208. The portion of the URI 208 before the hash relates to VHS Preview content designated "01 100", 
which is a product of a fictitious company called "movies*. The portion of the URI after the hash is an AV pointer 212, 
pointing to the second video 21 6 of the vhs (21 4) tape, and in particular to a segment (21 8) starting 900 seconds after 
the start of the documentary, and ending 1 800 seconds after the start of the documentary. 

[0082] The method of addressing an arbitrary fragment of an AV resource is preferably practiced using a conven- 
es tional general-purpose computer system 800, such as that shown In Rg. 1 4 wherein the processes of Figs. 4 and 7 to 
1 1 may be implemented as software, such as an application program executing within the computer system 800. In par- 
ticular, the steps of the method of addressing an arbitrary fragment of an AV resource are effected by instructions In the 
software that are earned out by the computer. The software may be divided into two separate parts; one part for carrying 
out the addressing methods; and another part to manage the user interface between the latter and the user. The soft- 
30 ware may be stored in a computer readable medium, including the storage devces described below, for example. The 
software is loaded into the computer from the computer readable medium, and then executed by the computer. A com- 
. puter readable medium having such software or computer program recorded on it is a computer program product. The 
use of the computer program product in the computer preferably effects an advantageous apparatus for addressing an 
arbitrary fragment of an AV resource in accordance with the embodiments of the invention. 
35 [0083] The computer system 800 comprises a computer module 801, input devices such as a keyboard 802 and 
mouse 803, output devices including a printer 815 and a display device 814. A Modulator-Demodulator (Modem) trans- 
ceiver device 81 6 is used by the computer module 801 for communicating to and from a communications network 820, 
for example connectable via a telephone line 821 or other functional medium. The modem 816 can be used to obtain 
access to the Internet, and other network systems, such as a Local Area Network (LAN) or a Wide Area Network 
40 (WAN). 

[0084] The computer module 801 typically includes at least one processor unit 605, a memory unit 806, for example 
formed from semiconductor random access memory (RAM) and read only memory (ROM), input/output' (I/O) interfaces 
including a video interface 807, and an I/O interface 813 for the keyboard 802 and mouse 803 and optionally a joystick 
(not illustrated), and an interface 808 for the modem 81 6. A storage device 809 is provided and typically includes a hard 

4S disk drive 81 0 and a floppy disk drive 81 1 . A magnetic tape drive (not illustrated) may also be used. A CD-ROM drive 
81 2 is typically provided as a non-volatile source of data. The components 805 to 81 3 of the computer module 801 , typ- 
ically communicate via an interconnected bus 804 and in a manner which results in a conventional mode of operation 
of the computer system 800 known to those in the relevant art. Examples of computers on whk:h the embodiments can 
be practised include IBM-PC's and compatibles, Sun Sparcstations or alike computer systems evolved therefrom. 

50 [0085] Typically, the application program of the preferred embodiment is resident on the hard disk drive 810 and 
read and controlled in its execution by the processor 805. Intemnediate storage of the program and any data fetched 
from the network 820 may be accomplished using the semiconductor memory 806, possibly in concert with the hard 
disk drive 81 0. In some instances, the application program may be supplied to the user encoded on a CD-ROM or floppy 
disk and read via the con-esponding drive 81 2 or 81 1 , or alternatively may be read by the user from the network 820 via 

55 the modem device 816. Still further, the software can also be loaded into the computer system 800 from other computer 
readable medium including magnetic tape, a ROM or integrated circuit, a magneto-optical disk, a radio or infra-red 
transmission channel between the computer module 801 and another device, a computer readable card such as a 
PCMCIA card, and the Internet and Intranets including email transmissions and Infonrtation recorded on websites and 
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may be practiced without departing from the scope and spirit of the inventioa meaiums 
Sh= '"^T °* addressing an artjitrary fragment of an AV resource may alternatively be implemented in ded- 
5 ^ °' '"''9'^'*'' •''"'"'^ °^ functLs of addresZ Such 

JL^Sh ""^r" w"^ ^'^''^ '"S"^' ^'9"^' P^°^^«°^. °^ °r more micS.,Sso;s anS 

eTu^r :hraXe::srcrnj^^^^^ ^^^^^'^^ - 

Sh- if ^ ^ describing the preferred embodiment is a convenient mechanism for 

descnbing the embodiment. It also allows a consistent view and addressing mechanism for both XML a^d non XML 
»<> resources. As noted previously however, this is not an essential feature of the present in^mion 

Industrial Applicability 

,5 S;~lng?nlXT""""''**^*'"'^^"'°^^^^^ 

[0089] The foregoing describes only some embodiment of the present invention, and modifications and/or chsnn^c 

20 Claims 

1. A method for addressing an AV fragment of an AV resou«:e over a network, to an arbitrary level of resolution said 
the dass of AV resources: said method comprising steps of: memoefs or 

detennining a URI network address for the AV resource- 
a^rSjirt^KteTC^^^^^^ 

detennining a fragment identifier for the fragment dependent upon the representation of the AV fraomenf and 

rA;;Cent'*"°* '"'^^ 

2. A method according to claim 1. wherein the detemiining of the fragment identifier includes a sub-step of: 
tifier. (b) the URI, and (iii) the fragment identifier and the URI. «»gmeni laen 

3. A method according to dalm 1 . wherein the detemiining of the fragment Identifier comprises a sub-step of: 
IS?.' ^"^ ^ *^ '''' ^ ^ "^'"^ "P°" the root Of the fragment 

4. A method according to either one of claims 2 and 3. wherein said identifying step comprises a sub-step of: 

«-ri't^^^''T ^'""'^ '° ""^ '^9'"'"* ^^^'^^ '"«'"ding at least one of 

ofr^JlouTe 



J(7 



5D 



55 



dm^^i^^TT ^l^^' r °' ''""^ ' ^' °^ t'^^ resource includes at least one of (i) 

digital video, (ii) analog video, (lii) compact d^c audio, (iv) analog audio, and (v) digital video disc. 

6. A method for locating an AV fragment of an AV resource over a network, to an art)itrary level of resolution said AV 

^r^A^ruZ'fjd^eth's' °' ^ '"^^^^ ^ -Lted wiCr^^^^^^ 

Class OT AV resources; said method compnsing steps of: 

using a URI network address portion of a URI reference to locate the AV resource- 

SierSl'^^^^^^^ H f r'""""' .""^ ''3'""* "^P^"^^"^ "P°" (a) the fragment Iden- 
tifier. (b) the URI. and (c) the fragment identifier and the URI ; and 
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applying an XPath based addressing scheme to the fragment identifier, said scheme including at least one of 
a time axis, a time function, a region axis, and a region function, for addressing temporal and spatial fragments 
of the AV resource, thereby locating the AV fragment. 



5 7. A method according to claim 6, wherein the identifying step comprises: 



identifying (i) the type of the AV resource, and (ii] the logical model, dependent upon the root of the fragment 
identifier. 



10 8. A method according to claim 6, wherein the type of the AV resource includes at least one of (i) digital video. (Ii) ana- 
log video, (ill) compact disc audio, (iv) analog audio, and (v) digital video disc. 

9. A method for addressing an AV fragment of an AV resource over a network, to an arbitrary level of resolution, said 
AV resource being a member of a class of AV resources, wherein a logical model is associated with members of 
15 the class of AV resources; said method comprising steps of: 



determining a URI network address for the AV resource; 

applying the logical model to the AV resource to form a hierarchical representation of the AV resource including 
a representation of the AV fragment; 
20 detemnining a fragment identifier for the fragment dependent upon the representation of the AV fragment, 

including a sub-step of identifying (i) a type of the AV resource, and (ii) the logical model, dependent upon one 
of (a) the fragment identifier, (b) the URI. and (iii) the fragment identifier and the URI; wherein said identifying 
step comprises a sub-step of applying an XPath based addressing scheme to the fragment identifier said 
scheme including at least one of a time axis, a time function, a region axis, and a region function, for address- 
es ing temporal and spatial fragments of the AV resource; and 

combining the URI network address and the fragment identifier to form a URI reference, being an address for 
the AV fragment 



10. An apparatus for addressing an AV fragment of an AV resource over a network, to an arbitrary level of resolution, 
30 said AV resource being a member of a class of AV resources, wherein a logical model Is associated with members 

of the class of AV resources; said apparatus comprising: 

first detemnining means for determining a URI network address for the AV resource; 
applying means for applying the logical model to the AV resource to fonm a hierarchical representation of the 
AV resource including a representation of the AV fragment; 

second determining means for detemnining a fragment identifier for the AV fragment dependent upon the rep- 
resentation of the AV fragment; and 

combining means for combining the URI network address and the fragment Identifier to form a URI reference, 
being an address for the AV fragment 

11. An apparatus according to claim 10, wherein the second determining means includes: 

identifying means for identifying (i) a type of the AV resource, and (ii) the logical model, dependent upon one 
of (a) the fragment identifier, (b) the URI, and (iii) the fragment identifier and the URI. 

45 

12. An apparatus according to claim 10, wherein the second detenmining means includes: 

identifying means for identifying (i) a type of the AV resource, and (ii) the logical model, dependent upon the 
root of the fragment identifier. 

50 

13. An apparatus according to either one of claims 1 1 and 12. wherein said identifying means includes: 

applying means for applying an XPath based addressing scheme to the fragment identifier, said scheme 
including at least one of a time axis, a time function, a region axis, and a region function, for addressing tem- 
55 poral and spatial fragments of the AV resource. 

14. An apparatus according to either one of claims 1 1 and 12. wherein the type of the AV resource comprises at least 
one of (i) digital video, (ii) analog video, (iii) compact disc audio, (iv) analog audio, and (v) digital video disc. 
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1 5. An apparatus for addressing an AV fragment of an AV resource over a network to »n a*it««, , 

s first detemiining means for detemiining a URI network address for the AV resource- 

second determining means for detennining a fragment identifier for the fragment decendent imnn th» r^r. 
sentat.on of the AV fragment, including identifying means for identifying ffl JSieT^ esourcrand m 
'0 the logcal model, dependent upon one of (a) the fragment identifier jb) me URI and nn^^hT^^^^^ 

and the URI; wherein said identrf^ng means comprLs second appj ng mea^s fo? iSaTx^arbl.^^^ 
addressing scheme to the fragment identifier, said scheme including « leL one JTa tS^^^^ 



utifeafon means for using a URI network address portion of a URI referance to locate the AV resource; 

2t IZ^ "'^ 'I'ete^'n'ng step for determining a URI network address for the AV resource- 

~*ft,r . constate, «.p (» c««*lng »,. URI «,»,rt, Md™„ »d«,.f™^«u,„,^.fcfc™,UP„^. 
-IST"' "™' " •»=»<. t.^ m, d«.^,„,„, ^ 

45 

code for an identifying step for identifying (i) a type of the AV resource, and (ii) the loqical model d«n«nrf«M 
upon one of (a) the fragment identifier, (b) the URI. and (iii) the fragment identiflr anS uT 

so Tnc^er' "'""'^ ^""^''"^ ^° ^ ^' '^''-^ t'^e -cond detennining step 

s^r re fC~r ^ " ~- 

code for an applying step for applying an XRath based addressing scheme to the fragment identifier, said 
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scheme including at least one of a time axis, a time function, a region axis, and a region function, for address- 
ing temporal and spatial fragments of the AV resource. 

21. A computer readable memory medium according to 1 8 and 1 9, wherein the type of the resource comprises at least 
5 one of (i) digital video, (ii) analog video, (iii) compact disc audio, (iv) analog audio, and (v) digital video disc. 

22. A computer readable memory medium for storing a program for apparatus for addressing an AV fragment of an AV 
resource over a network, to an arbitrary level of resolution, said AV resource being a member of a class of AV 
resources, wherein a logical model is associated with members of the class of AV resources; said program com- 

10 prising: 

code for a first determining step for determining a URl network address for the AV resource; 
code for a first applying step for applying the logical model to the AV resource to form a hierarchical represen- 
tation of the AV resource including a representation of the AV fragment; 

15 code for a second determining step for detenmining a fragment identifier for the fragment dependent upon the 

representation of the AV fragment, including code for an identifying step for identifying (i) a type of the AV 
resource, and (ii) the logical model, dependent upon one of (a) the fragment identifier, (b) the URl, and (iii) the 
fragment identifier and the URl; wherein said code for the identifying step comprises code for a second apply- 
ing step for applying an XPath based addressing scheme to the fragment Identifier, said scheme including at 

2o least one of a time axis, a time function, a region axis, and a region function, for addressing temporal and spa- 

tial fragments of the AV resource; and 

code for a combining step for combining the URl network address and the fragment identifier to form a URl ref- 
erence, being an address for the AV fragment 

25 23. A computer readable memory medium for storing a program for apparatus for locating an AV fragment of an AV 
resource over a network, to an arbitrary level of resolution, said AV resource being a member of a class of AV 
resources, wherein a logical model is associated with members of the class of AV resources; said program com- 
prising: 

30 code for a utilisation step for using a URl network address portion of a URl reference to locate the AV resource; 

code for an identifying step for identifying (I) a type of the AV resource, and (ii) the logical model, dependent 
upon one of (a) the fragment identifier, (b) the URl, and (c) the fragment identifier and the URl ; and 

35 code for an applying step for applying an XPath based addressing scheme to the fragment identifier, said 

scheme including at least one of a time axis, a time function, a region axis, and a region function, for address- 
ing temporal and spatial fragments of the AV resource, thereby locating the AV fragment. 

24. A signal carrying machine readable instructions for causing a processor to perform a method according to any one 
40 of claims 1 to 9 or causing the processor to perform as an apparatus according to any one of claims 1 0 to 1 6. 
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#avptr(/dvdVideo/title/chapter/audio[1J) 
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